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We consider an infinite dimensional system of stochastic differen- 
tial equations describing the evolution of type frequencies in a large 
population. The type of an individual is the number of deleterious 
mutations it carries, where fitness of individuals carrying k muta- 
tions is decreased by ak for some a > 0. Along the individual lines 
of descent, new mutations accumulate at rate A per generation, and 
each of these mutations has a probability 7 per generation to disap- 
pear. While the case 7 = is known as (the Fleming-Viot version 
of) Muller's ratchet, the case 7 > is associated with compensatory 
mutations in the biological literature. We show that the system has a 
unique weak solution. In the absence of random fluctuations in type 
frequencies (that is for the so-called infinite-population limit) we ob- 
tain the solution in a closed form by analyzing a probabilistic particle 
system and show that for 7 > the unique equilibrium state is the 
Poisson distribution with parameter A/(7 + a). 

1. Introduction and outline. We study a multitype Wright -Fisher 
SDE (or Fleming-Viot process) of the form 

00 

dX k = {a{^[t - k)X^X k + A(X fc _x - X k ) 
(*) e=0 

+ 7 ((fc + l)X k+1 - kX k ))dt + ^2^X k X e dW ke , 

for k = 0,1,... with X_i := 0, X Q ,Xi,... > and ^2T =0 X k = 1 - Here 
a, A and 7 are (small) non-negative constants, N is a (large) number (or 
equals infinity in which case the last term on the r.h.s of (*) vanishes), and 
(W k i) k> £ is a family of independent Brownian motions with W k i = —Wg k . 

The interest in this system comes from population genetics (see Section 2 
for some background). The equations (*) provide a diffusion approximation 
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of the evolution of the type frequencies Xj~, k £ No in a population of con- 
stant size that consists of a large number N of individuals. The type k of 
an individual is given by the number of deleterious mutations it carries. 
The fitness (which is proportional to the average number of offspring) of a 
type-fc individual is proportional to (1 — a) k ~ 1 — ak, where a is a (small) 
positive number called the selection coefficient. The parameter A is the ex- 
pected number of additional mutations that accumulate per individual and 
generation, and for each of the mutations present, 7 is the probability that 
this mutation disappears in one generation. 

In this work we will not be concerned with proving the convergence of 
the discrete-generation dynamics to the diffusion approximation. Still, in 
Section 3.3 we will use the discrete generation scheme as just described 
in order to present a few simulation results which illustrate how certain 
functionals of the solution of (*) (in particular the mean and the variance 
of the probability vector (X}-)k=o,i,2,...) depend on the model parameters. 

Theorem 1 in Section 3.1 states that (*) has a unique weak solution. Note 
that (*) is an infinite dimensional SDE with an unbounded non-linear drift 
coefficient. Related existence and uniqueness results were obtained by Ethier 
and Shiga (2000). However, these authors only cover the case of parent- 
independent mutation and not the situation of (*). 

Theorem 2 in Section 3.2 gives the explicit solution of (*) in the (determin- 
istic) case N = 00. This extends results from Haigh (1978) and Etheridge 
et al. (2008) for the case 7 = 0. In particular, we show that the Pois- 
son weights with parameter A/ (7 + a) constitute the only equilibrium state 
of (*) for N = 00. The proofs of Theorems 1 and 2 are given in Sections 4 
and 5, respectively. An essential step in the proof of Theorem 2 is Proposi- 
tion 5.2 which in the case N = 00 provides the solution of (*) in terms of a 
probabilistic particle system. 

2. History and background of the model. For 7 = 0, the system 
(*) is known as (the Fleming- Viot version of) Muller's ratchet, a population 
genetic model introduced by Hermann Muller (1964): A clonal population of 
fixed size reproduces randomly. Each individual carries a number of muta- 
tions, all of which are assumed to be deleterious. Fitness decreases linearly 
with the number of mutations. The offspring of an individual has a small 
chance to gain a new deleterious mutation. In particular, any offspring of an 
individual carries at least as many mutations as the parent and mutation is 
an irreversible process. Hence, eventually the ratchet will click in the sense 
that the so far fittest type will irreversibly disappear from the population. In 
this way, the mutation process drives the population to a larger number of 
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deleterious mutations while selection acts in the opposite direction, leading 
to a form of mutation-selection quasi-balance. Gabriel et al. (1993) consider 
a related model of a clonally reproducing population in which the evolution 
of the population size is coupled with the mean fitness of the population, 
eventually leading to extinction of the population. The prediction of this 
mutational meltdown requires information on the rate at which deleterious 
mutations accumulate in the population (Loewe, 2006), i.e. on the rate of 
Muller's ratchet. 

Several quantitative treatments of Muller's ratchet have already been 
given (Haigh, 1978; Stephan et al., 1993; Gessler, 1995; Higgs and Woodcock, 
1995; Gordo and Charlesworth, 2000; Maia et al., 2003; Rouzine et al., 2003; 
Etheridge et al., 2008; Jain, 2008; Waxman and Loewe, 2010; Audiffren and 
Pardoux, 2011). The most interesting question concerns the rate of Muller's 
ratchet. This has so far only been studied by simulations, or approximations 
which seem ad hoc. 

We study an extension of Muller's ratchet where deleterious mutations 
are allowed to be compensated by (back-)mutations. It is important to note 
that such compensatory mutations are different from beneficial mutations, 
although both increase the fitness of an individual. The latter are usually as- 
sumed to have an effect that does not depend on the genetic background. In 
contrast, compensatory mutations can only remove the effects of previously 
gained deleterious mutations. The possibility of such compensatory muta- 
tions was discussed already by Haigh (1978) (see also Maynard Smith, 1978). 
He argued that they rarely occur in realistic parameter ranges, because the 
deleterious mutation rate is proportional to the full length of the genome 
of a clonally reproducing individual, while the compensatory mutation rate 
scales with the length of a single base within the full genome. Therefore, 
he concluded that compensatory mutations are too rare to halt the accu- 
mulation of deleterious mutations in realistic parameter ranges. However, 
when several deleterious mutations are gained, the total rate of accumula- 
tion of deleterious mutations increases and may therefore halt the ratchet. 
An equilibrium is approached where a certain number of deleterious muta- 
tions is fixed. If this number is large enough, these may lead to extinction of 
the population. While Antezana and Hudson (1997) argue that the effects 
of compensatory mutations can be an important factor for small viruses, 
Loewe (2006) concludes that compensatory mutations are still too rare to 
halt the mutational meltdown of human mitochondria. 

Clearly, the relevance of compensatory mutations is greatest for species 
with a short genome and a high mutation rate. One of the most extreme 
groups in these respects are RNA viruses (for which the genome length is 
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of the order of 10 3 to 10 4 bases and the per base mutation rate is around 
1CP 5 to 10 -4 ). As discussed in Chao (1990), back mutations can hardly 
stop Muller's ratchet even in this case. We will come back to this numerical 
example in Section 3.3 below. 

The relevance of Muller's ratchet with compensatory mutations is sup- 
ported by the fact that a deleterious mutation might be compensated not 
only by a back mutation that occurs at the same genomic position. As 
discussed by Wagner and Gabriel (1990), restoring the function of a gene 
which was subject to a mutation is as well possible by mutating a second site 
within this gene, or even within a gene at some other locus. Maisnier-Patin 
and Andersson (2004) give the following generalizations of (single-base) com- 
pensatory mutations: (i) point mutations which restore the RNA secondary 
structure of a gene or the protein structure, (ii) an up-regulation of gene 
expression of the mutated gene, (iii) a mutation in another gene restoring 
the structure of a multi-unit protein complex and (iv) a bypass mechanism 
where the function of the mutated is taken over by another gene. 

Various examples give clear evidence for the existence of compensatory 
mutations. It has been shown by Poon and Chao (2005) that a deleteri- 
ous mutation in the DNA bacteriophage phiX174 can be compensated by 
about nine different intragenic compensatory mutations. This implies that 
the rate of compensatory mutations can be high enough to halt accumu- 
lation of deleterious mutations under realistic scenarios. In fact, compen- 
satory mutations have been observed in various species. Howe and Denver 
(2008) showed that deletions in protein-coding regions of the mitochondrial 
genome in Caenorhabditis briggsae lead to heteroplasmy, a severe factor in 
mitochondrial diseases. They also found compensatory mutations leading to 
a decrease in heteroplasmy. Mutations for antibiotic resistance of bacteria 
are known to be deleterious in a wild-type population. Fitness can be in- 
creased by a compensatory mutation (see e.g. Handel et al., 2006). Plastid 
genomes of mosses are studied in Maier et al. (2008). Here, it is suggested 
that deleterious mutations may be compensated by RNA editing, a mecha- 
nism by which the base C in DNA is transcribed to U on the level of RNA 
for specific bases in the genome. 

All these examples indicate that the role of compensatory mutations 
should be taken into account. A relevant question to be addressed in fu- 
ture research is which parameter constellations (of the selection coefficient, 
the mutation rate, the compensatory mutation rate and the population size) 
can halt the ratchet before the mutational meltdown leads to extinction of 
the population. 
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3. Results. We show that for finite N the system (*) has a unique 
weak solution (Theorem 1). For the system (*) without noise (i.e. the case 
N = oo) we provide in Theorem 2 the explicit form of the solution as 
well as the equilibrium state. For this we use a stochastic particle model 
(including accumulation and loss of mutations, as well as a state-dependent 
death rate of the particles) and show in Proposition 5.2 that a solution of (*) 
with N = oo is given by the distribution of the particle system conditioned 
on non-extinction. After stating the theorems, we compare in Section 3.3 
the cases of large N with the theoretical considerations for N = oo using 
simulations. 

3.1. Existence and uniqueness. The system (*) of Muller's ratchet with 
compensatory mutations takes values in the space of probability vectors 
indexed by No, i.e. sequences whose entries are probability weights on No- 
We restrict the state space to the subset of probability vectors with finite 
exponential moment of a certain order, and show uniqueness in this space. 
Throughout, we abbreviate x := (xq, xi, • • •) G 

Definition 3.1 (Simplex). The infinite- dimensional simplex is given 

by 

oo 

(3.1) §:= {x€K*° : ^x fc = l}. 

k=0 

Moreover, for £ > 0, set 

oo 

(3.2) Ms) 

k=0 

and consider elements of § with £th exponential moment, forming the space 

(3.3) S ? := {x G § : h^x) < oo}. 

Remark 3.2 (Topology on S$). We note that 

oo 

(3.4) r(x,y) :=^2e^ k \x k -yk\, S,yG§ ? , 

fc=o 

defines a complete and separable metric on §£. 

Theorem 1 (Well-posedness of Fleming-Viot system). Let x G for 
some £ > 0. Then, for N G (0, oo), a, A, 7 G [0, oo), the system (*) starting 
in X(0) = x has a unique E>-valued weak solution X = (X(t))t>n, taking 
values in the space Cs £ ([0, 00)) of continuous functions on §£. 



G 



In the sequel, we will refer to the process X as Mutter's ratchet with compen- 
satory mutations with selection coefficient a, mutation rate A, compensatory 
mutation rate 7 and population size N. 

Remark 3.3 (Population size N). Resampling models are usually stud- 
ied either for a finite population of constant size N (e.g. using a Wright- 
Fisher model), or in the large population limit with a suitable rescaling of 
time, leading to Fleming- Viot processes. For a bounded fitness function and 
a compact type space, it is well known that a sequence of (discrete time) 
Wright-Fisher processes, indexed by N, converges weakly to a Fleming- Viot 
process (or Wright-Fisher diffusion) if the selection and mutation coefficients 
are scaled down by N and one unit of time is taken as N generations; see e.g. 
Ethier and Kurtz (1993). In our situation it may thus be expected (though 
we do not prove this claim here) that for large N and for aN, XN and 
of order one, the Wright-Fisher process described in Section 3.3, run with a 
time unit of ./V generations, is close to the solution of (*), with 1 instead of 
y/l/N as the coefficient of the noise, and aN, XN and 7JV in place of a, X 
and 7. However, this system is (*) with time speeded up by a factor N. In 
other words, for large N, and aN, XN and 7 A of order one, the solution of 
(*) should be close to the corresponding Wright-Fisher model as introduced 
in Section 3.3, with time unit being one generation. This is the reason why 
we refer to the model parameter N in (*) as the population size. We use 
this terminology in interpreting the simulation results for the Wright-Fisher 
model in Section 3.3. 

Remark 3.4 (Connection to previous work for 7 = 0). For the case 
H = 0, variants of Theorem 1 appear in Cuthbertson (2007) and in Audiffren 
and Pardoux (2011). The latter makes (in the terminology of our Theorem 
1) the special choice £ = aN and refers to Audiffren (2011) for the proof. 
Cuthbertson (2007) treats also the case of a < 0, assuming the existence of 
all exponential moments of the initial state. 

Remark 3.5 (Strategy of the proof of Theorem 1). For a = 0, it follows 
from classical theory (Dawson, 1993, Theorem 5.4.1) that (*) has a unique 
weak solution. The same is true if the selection term ot(^2eLo(@ — k)X()Xk 
is replaced by a bounded function of A. This can be shown by a Cameron- 
Martin-Girsanov change of measure from the case a = 0, using similar 
arguments as in Ethier and Shiga (2000) So, the main difficulty in the proof 
is to deal with the unbounded selection term. This is overcome by showing 
that the change of measure still works when using §>£ as the state space for 
X. 
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Remark 3.6 (Strong solution of (*)). Theorem 1 gives existence and 
uniqueness of weak solutions of (*). To the best of our knowledge, a result 
on uniqueness of strong solutions so far is not available even in the case 
7 = A = a = 0. The reason why general theory does not apply in this multi- 
dimensional situation is that the diffusion term yJX k X^ is only Holder rather 
than Lipschitz continuous. However, let us mention two related results. 

(i) Shiga and Shimizu (1980) provide in their Theorem 3.4 existence and 
uniqueness of strong solutions for a class of SDE's which are similar 
to our system (*). One may conjecture that this theorem is also valid 
for the drift term appearing in our system (*). This would then give 
an alternative proof of our Theorem 1. However, the diffusion term in 
the SDE considered in Shiga and Shimizu (1980) is assumed to have a 
lower triangular form, which seems to be a tribute to the mathematical 
technique rather than to a biological interpretability from a "strong" 
(i.e. realisation-wise) point of view. 

(ii) Recently, Dawson and Li (2010) (see their equation (4.1)) studied 
strong existence and uniqueness for a related system of stochastic 
flows. Here, white noise on [0, oo) x [0, 1] is used to model the reproduc- 
tion of the individuals in the (unstructured) population, irrespective 
of their type. 

3.2. The case N = oo. This case (which is not included in Theorem 1) 
leads to a deterministic dynamics. For 7 = 0, Haigh (1978) was the first 
to obtain results on the deterministic evolution of X in a discrete time 
setting. These results were later refined by Maia et al. (2003). Here, we work 
with continuous time, and our next theorem generalizes Proposition 4.1 in 
Etheridge et al. (2008) to the case 7 > 0. We are dealing with the system 

00 

(3.5) x k = a( y~](£ ~ k ) x e) x k + K x k-i ~ x k) + l((k + l)x k+1 - kx k ) 
1=0 

for k = 0, 1, 2, . . . with x-\ := and Ylh=o x k = 1- 

Theorem 2. Let a, A, 7 G [0, 00) and x(0) G for some £ > 0. Then, 
the system (3.5) has a unique S-valued solution (x(t))t>o which takes values 
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in §£. It is given by 
(3.6) 



x k (t) 



oo 

£ ^(0)(^ - ^e-(-+7)*) 1 • exp (^(1 - e-(«+7)*)) 

i=0 



In particular, if either 7 > or xo(0) > 0, £/ten 

(3.7) x k (t)^ — •( — — ) , £ = 0,1,2,. .. 

fc! Va + 7/ 

i.e. the limiting state as t — > 00 is the vector of Poisson weights with param- 
eter A/(a + 7). 

Remark 3.7 (Equilibria). In the case 7 = it is known already from 
the work of Haigh (1978) that the vector of Poisson weights with parameter 
A/a is an equilibrium state. Moreover, Poisson states which are shifted by 
k = 1,2,... are equilibria as well. This is in contrast to the case 7 > 
where only a single equilibrium state exists. Moreover, this equilibrium state 
depends on the model parameters only through the value of A/(a + 7). It is 
worth noting, however, that for finite N the distribution of the process does 
not merely depend on A/ (a + 7). See Figure 3 for a simulation study of this 
feature for N < 00. 

Here is a heuristic argument why the equilibrium state is given by a Pois- 
son distribution with parameter A/(7 + a) in the case N = 00. Consider the 
number of mutations along a single line which are accumulated at rate A, 
each of which is compensated at rate 7, and if the line carries k mutations, 
the line is killed at rate ak. We will see in Proposition 5.2 that the equi- 
librium distribution of (3.5) equals the quasi-equilibrium for this Markov 
chain, i.e. the equilibrium distribution of mutations given the line has not 
been killed. In the case a = (and A, 7 > 0), the number of mutations can 
be seen as an M/M/oo-queueing system: In equilibrium an individual carries 
Pois(A/7)-many mutations. These mutations have i.i.d. Exp(7)-distributed 
ages. In the case a > 0, the equilibrium distribution can be constructed 
from that for a = by conditioning on the event that none of the present 
lines experienced the killing caused by the mutations it carries. Since each 
mutation has an independent Exp(7) distributed age, this gives a the chance 

(^■^^j for survival of the line. The claim then results from the following el- 
ementary fact: Consider a population with Poisson(/3)-distributed size with 



imsart-aap ver. 2009/08/13 file: PSWllrev.tex date: November 8, 2011 



3 RESULTS 



9 



P = A/7. Then, conditional under the event that this population remains 
completely intact under a thinning with survival probability p = 7/(0 + 7), 
the size of the population is Poisson(/3p) distributed. 

Remark 3.8 (Connection to the rate of adaptation) . Although the strat- 
egy of our proof requires that a > (i.e. the mutations are deleterious), it 
can be shown by taking the time-derivative of the right hand side of (3.6) 
that this equation is a solution for a < as well. This model is frequently 
termed rate of adaptation and has gained some interest in the case 7 = 
and N < 00 (Gerrish and Lenski, 1998; Desai and Fisher, 2007; Park and 
Krug, 2007; Yu et al., 2010). 

Taking a < in our model, all mutations are beneficial and 7 is the rate 
by which any beneficial mutation is compensated. Interestingly, only in the 
case I a I < 7 (i.e. selection is weaker than the compensatory mutation rate) 
an equilibrium state exists, and is still Poisson with parameter A/ (7 — |a|). 
In the case \a\ > 7, no equilibrium exists because new beneficial mutations 
spread through the population quicker than compensatory mutations can 
halt this process. It will be interesting to investigate the switch between 
these two scenarios in the case of finite N. 

3.3. Simulations. We use simulations based on a discrete Wright-Fisher 
model to study the evolution of the mean fitness, and to investigate the 
dependence of the mean and the variance of the type frequency distribution 
on the model parameters. Fixing a population size N, this model is a discrete 
time Markov chain (Y^(t))t=o,i,2,... taking values in {y G § : Ny G Nq } and 
such that 



p(y(t + i) 



y\W)) = 



Ny Nyi Ny 2 --- 



N 




where 




m=j 



(iii) 




for small parameters a, A and 7. The sampling weights (pj)j=o,i,... describe 
selection, mutation and compensatory mutation. The idea in this scheme 
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(which is standard in population genetics) is that (i) any individual produces 
a large number of gametes, but an individual with k deleterious mutations 
only contributes a number proportional to (1 — a) k to the gamete pool, (ii) 
every deleterious mutation has a small, independent chance 7 to be removed 
while the gamete is built, and (iii) the number of new deleterious mutations 
is Poisson distributed with parameter A. After building these gametes, N 
individuals are randomly chosen from the gamete pool to form the next 
generation. Since a, 7 and A are assumed to be small, the order in which the 
three mechanisms (i), (ii), (iii) come into play is negligible. (E.g., if we would 
assume - in contrast to our simulation scheme above - that compensatory 
mutations arise before gametes are built proportional to the relative fitness of 
individuals. Then an individual with a high number of deleterious mutations 
would produce slightly more gametes than in our simulation scheme.) For 
our simulations, the working hypothesis is that (Y_{Nt))t>o behaves similar 
to X = (X(Nt))t>n where X is the solution of (*) with parameter N; see 
Remark 3.3. 

We simulated (Y_(Nt))t>o for various combinations of N, a, A and 7, start- 
ing with Y_(0) = 5q, i.e. no deleterious mutations are present at start. Since 
in reality compensatory mutations are less probable than mutations, we 
mostly simulate scenarios with 7 <C A. (For the biological background of 
this assumption, see Section 2.) Hence, our simulations can be considered as 
a small perturbation of the case 7 = 0, the case of Muller's ratchet (with- 
out compensatory mutations). We compare scenarios where Muller's ratchet 
clicks rarely with others in which it clicks more frequently. For example, in 
Figure 1(A) we use N = 10 3 , A = 0.1, a = 0.03 where the ratchet has about 
5.7 clicks in N generations. In Figure 1(B) we use N = 10 where the ratchet 
has only about 0.34 clicks in N generations. Both figures show the initial 
phase of the simulation for a small compensatory mutation rate of 7 = 10~ 4 . 
Recall that Theorem 2 predicts an equilibrium number of A/(a + 7) ~ 3.3 
deleterious mutations in the case N = 00. This value is reflected in our sim- 
ulations only in Figure (B) where Muller's ratchet clicks rarely. In Figure 
(A), not only is the average number of deleterious mutations much larger 
than the prediction from Theorem 2, but also the fluctuations are much 
larger than in Figure (B). However, in both parameter constellations we see 
that the accumulation of deleterious mutations by Muller's ratchet is slowed 
down (and sooner or later halted) due to the compensatory mutations. 

Figure 2 illustrates for a finite N, how far the mean and variance of the 
number of deleterious mutations deviate from those Poisson distribution, 
which appears in Theorem 2 for the case N = 00. Again, we see that for 
fixed a, A and small compensatory mutation rate 7, the equilibrium for ki 
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Fig 1. The evolution of the average number of deleterious mutations ki is plotted. In 
addition, the single path is compared to the average over 50 different simulations . (A) 
A parameter combination where Adulter's ratchet without compensatory mutations (i.e. 
7 = 0) clicks frequently, while it clicks much less frequent in (B). 



is close to A/(a + 7) only if the ratchet without compensatory mutations 
(7 = 0) does not click too often. If N = 10 4 in Figure 2(A), there are 
approximately 152 clicks in iV generations in the absence of compensatory 
mutations while in Figure 2(B) this rate is much lower, approximately 0.34 
clicks per N generations (we use the same parameter values a, A and 7 as 
in Figure 1(B)). These examples show that compensatory mutations halt 
the ratchet quite efficiently Note that the parameter values A = 0.1 and 
7 = 10 -4 fit to the evolution of RNA viruses, e.g. for a genome of length 10 3 
bases, if the per base mutation rate is 10 -4 and a population of size 10 4 . As 
our simulations show, the ratchet is halted provided the selection coefficient 
is large enough. This is in some contrast to Chao (1990) who argues that 
compensatory mutations are too rare in RNA viruses to halt the ratchet. 

Another surprising fact in Figure 2(A) is that the empirical variance of 
the number of deleterious mutations in the population is always close to 
the prediction of A/ (a + 7) from the Poisson state appearing in Theorem 2. 
This would be compatible with the hypothesis that the type frequencies 
for the Wright-Fisher model are (in equilibrium) close to a shifted Poisson 
distribution. The detailed study of the amount of this shift, in particular 
for a parameter constellation for which 7 = leads to frequent clicks, is a 




Fig 2. The empirical distribution of Ki and K2 are evaluated between generations 5- 10 2 iV 
and 10 3 JV. The plot for Ki includes the resulting 10% and 90% quantiles. In absence of 
compensatory mutations and with N — 10 4 , the same parameters lead to approximately 
152 clicks per N time units for Figure (A), while 0.34 clicks per N time units are obtained 
for Figure (B). 



delicate issue. Its answer certainly depends on the rate of clicking of Muller's 
ratchet without compensatory mutations, a problem which remains unsolved 
until now. 

Yet another interesting feature seen in Theorem 2 is the symmetric de- 
pendence on a and 7 of the equilibrium state. We checked in which direction 
this symmetry is violated for finite N . As seen from Figure 3, compensatory 
mutations can halt the ratchet more efficiently than selection. The reason 
is that compensatory mutations reduce the number of mutations no matter 
how many mutations are fixed in the population, whereas the number of 
fixed mutations cannot decrease due to selection. 

4. Proof of Theorem 1. Our approach is inspired by Ethier and Shiga 
(2000), who deal with the case of unbounded selection if mutation is parent- 
independent. In order to prove that (*) has a unique weak solution, we 
use the equivalent formulation by a martingale problem and show its well- 
posedness (see Proposition 4.4). We provide bounds on exponential moments 
for any solution of the martingale problem associated with the generator of 
(*) in Lemma 4.5. The central step is Proposition 4.8 which provides a 
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Fig 3. The parameter A/ (a + 7) of the Poisson equilibrium state in the case N — 00 is 
symmetric in a and 7 (see Theorem 2). We fix a + 7 and see that the average number of 
deleterious mutations is higher for low values of*/. Again, the 10% and 90% quantiles are 
given. 



Girsanov change of measure by which solutions of the martingale problem 
for a = are transformed to solutions for any a > 0. Proposition 4.4 and 
Theorem 1 then follow because the martingale problem for a = is well- 
posed, and can be transformed to a solution for the martingale problem for 
a > which also solves (*). This shows existence. Uniqueness again follows 
by using a Girsanov transform. 

4.1. Martingale problem. We start by defining the generator for the 
Fleming- Viot system of Muller's ratchet with compensatory mutations. The 
unboundedness in the selection term of this generator requires particular 
care in the analysis of the corresponding martingale problem. First we fix 
some notation. 

Remark 4.1 (Notation). For a complete and separable metric space 
(E, r), we denote by T'(E) the space of probability measures on (the Borel 
sets of) E, and by (resp. 6(E)) the space of real- valued, measurable 

(and bounded) functions. If E C M N «, we let C fc (E) (C fe fc (E)) be the (bounded), 
k times partially continuously differentiable functions (with bounded deriva- 



14 



tives). Partial derivatives of / G C 2 (E), E C M N ° will be denoted by 

(4.1) fkt-=-/C~, M = 0,l,2,... 

Definition 4.2 (Martingale problem). Let (E, r) be a complete and 
separable metric space, x G E, T C .M(E) and G a linear operator on 
.M(E) with domain T . A (distribution P of an) E-valued stochastic process 
X = (Xt)t>o is called a solution of the (E, x, G, ^-martingale problem if 
Xq = x and X has paths in the space Pe([0, oo)), almost surely, and for all 
/ € T, 



(4.2) (/(X t ) - f(X ) - j Gf(X s )ds 



is a P-martingale with respect to the canonical filtration. Moreover, the 
(E, x, G, ^-martingale problem is said to be well-posed if there is a unique 
solution P. 

For a fixed £ > 0, our state space will be (§£,r), cf. Definition 3.1 and 
Remark 3.2. We now specify the generator and its domain. 

Definition 4.3 (Generator for Fleming- Viot system). 
1. On S, consider functions of the form 

f{x) := f Vu ... tVn (x) := (x,fi)---(x,<f n ), 

(4.3) 



for n = 1, 2, . . . and tp, tpi, . . . , (p n £ .M(No). Let 

T := the algebra generated by 
(4.4) {f vu ...,ip n ■ <fi 6 A^(N ) with bounded support, 

i = 1, ... ,n, n G N}. 
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2. We define the operator G% as the linear extension of 

G%f(x) = G« cl f(x) + G mut /(x) + G cmut f(x) + Ggj(x), 

oo oo 

G se\f(x) = a ^2(£ - k)x e x k f k (x), 

oo 

G mut f(x) = \)(x k -i - x k )f k (x), 
(4-5) fr 

oo 

Gcmut/(x) = 7^Z^ fc + 1 ) X ^+1 ~ kx k )fk(x), 
k=0 

oo 

G^eJ(x) = 2]V ~ x t)fki(x) 

k,e=o 

with a, A, 7 G [0, oo), iV G (0, oo), for / of the form (4.3) whenever the 
right hand sides of (4.5) exist (which is certainly the case if x has a 
first moment and the tpi, . . . , (p n have bounded support). In particular, 
for all / G T and £ > 0, the function is defined on §£. 

3. For / = f we define M f = {N f (t)) t > by 

(4.6) N f (t) := f(X(t)) ~ f G a x f{X{s))ds 

Jo 

whenever G^f(X(t)) exists for all t > 0. 

Proposition 4.4 (Martingale problem is well-posed in Sf). Let x G 
/or some £ > 0, G x as in (4.5) and a, A, 7 G [0, 00), iV G (0, 00) and T be 
as in (4.4). Then, the (E,x,G x , ^-martingale problem is well-posed and is 
a process with paths in C§J[Q, 00)). 

Proposition 4.4 is a crucial step in the proof of Theorem 1. Both proofs 
are carried out in Section 4.3. Now we start with bounds on exponential 
moments, which will be fundamental in further proofs. 

Lemma 4.5 (Bounds on exponential moments). Let x G §>£ for some 
£ > and X = (X(t))t>o be a solution of the (S,x,G x , J- ) -martingale 
problem. Then, 

(4.7) E[^(X(t))] < fc € (x) • exp (At(e ? - 1)) 

and for allT > and e > 0, there is C > 0, depending on T, e, £ and A (but 
not on a, 7, N ) with 

(4.8) P[ sup ht(X(t)) > C] < e ■ h^x). 

0<t<T 
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Proof. Define for m = 0, 1, 2, . . . the function h^ m £ J- by 

m mm 

h, m (x) := x k^ k + e* m (l - x k) =e^ m + Yl x ^ ~ e ^ 



k=0 fc=0 k=0 

and note that 

oo 

h, m {x) = x k e^ kAm) for x E S. 
fc=0 

First, we compute 

m m— 1 

G mut /^ m (x) = A^(x fc _! - x fc )(e« fc - e« m ) = A ^ * fc (e^ +1 ) - e« fc 

k=0 k=0 
m—l 

= A(e ? - 1) Yj x k^ k > 0, 

fc=0 

m 

G cmnt h^ m (x) =1 J2((k + l)x fc+ i - kx k )(e^ h - e ?m ) 

fc=0 
m 

fe=i 

m oo 

fc=0 £=0 

oo oo 

= aJ2 ~ k)x e x k (e^ kAm ^ - e« m ) 

oo oo 

= a Yl - k)x e x k e^ kAm) < 0, 
k=o e=o 

where the calculation for the term G" el holds for x E §. (For the last in- 
equality, assume that Z is an No-valued random variable with distribution 
x. Then, G se ih^ m (x) = -a Cov[Z, e^ ZAm '] < 0, since two increasing trans- 
formations of a random variable Z have a nonnegative correlation, or in 
other words, the singleton family {Z} is associated.) 
In the next step we prove (4.7). We write 

jB[h^ m (X(t))} = E[G£% m (X(t))] < E[G mut % m (X(t))] 

m— 1 

( 4 - 9 ) =A(^-1).E[£**(*)^ 

fe=0 

< A(e«-l)E[% m (X(i))]- 
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So, by Gronwall's inequality, 

E[% m QC(i))] < hz, m (x) ■ exp (At(e ? - 1)) 

which gives (4.7) by monotone convergence. 

Finally, by Doob's submartingale inequality and monotone convergence, 
using (4.9), 

P[ sup ht(X(t)) >C]= lim P[ sup ht m (X(t)) > C] 

0<t<T m ^°° 0<t<T ' 



< lim P 

m— >oo 



sup (h^ m (X(t)) - / G cm _ ut h^ m (X(s)) 
<t<T v jo 

+ G se ih^ m (X(s))ds\ > C 

h,mi X -( T )) ~ / G cmnt h^ m (X(s)) + G se \h^ m (X(s))ds 
Jo 

- lim (% m (x) + / E[G mu t^, m (X(s))]ds) 
^(h^(x) + A(e* - l)/t ? (x) / exp(As(e 5 -l))ds) 



< J- lim E 



< 

- c 



< 

" c 

and the result follows. □ 

For the change of measure applied in the next subsection, we will need 
that the martingale property of Nf extends from J 7 to a wider class of 
functions. 

Lemma 4.6. Let x £ Sg for some £ > and X = (X_ t )t>o be a solution 
of the (§, x, G%, J~) -martingale problem and 

f = f<p u ..., Vn be of the form (4.3) with \(fi(.)\ < Ce c 

for some C > and ( < £, i = 1, . . . , n. 

Then, (Nf(t))t>o given by (4.6) is a martingale. 

Proof. We first observe that G^f(X_(t)) exists for all t > 0, hence Nf 
is well-defined. For tp G y\4(N + ), let tp m (k) := tp(k A m). We note that 
SfcLo x k¥ m {k) = <£{m) + YIk=o x k(p(k) - ^( m )) f° r x £ S. Hence, for 
ftpi,...,<p n as gi ven m the lemma, the function f v r^ } .„ itp m coincides on § with a 
function in J 7 . Clearly, (Nf m m (*))t>o is a martingale by assumption for 
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all m = 0, 1, 2, . . . Using (4.7) and dominated convergence 

E[iV Mi ...^(t)|(X(r)) r < s ] = Yun^E[N w ^(t)\(X(r)) r < s ] 

= lim N f m m (s) = iV> (s). 

In other words, (Nf(t))t>o is a martingale. □ 

4.2. Girsanov change of measure. In Proposition 4.8 we establish a 
change of measure which shifts the selection coefficient a of Muller's ratchet 
with compensatory mutations. Two assertions from semimartingale theory 
which will be required in the proof are recalled in the next remark. 

Remark 4.7. 1. A condition for a local martingale to be a martin- 
gale: Let M = (N t )t>o be a local martingale. If E[sup 0<4<T \N t \] < oo 
for all T > 0, then M is a martingale (see e.g. Protter, 2004, Theorem 
1.51). 

2. Girsanov Theorem for continuous semimartingales: Let C = (Lt)t>o 
be a continuous P-martingale for some probability measure P such 

that Z = (Zt)t>o, given by Z% = e ' 2^ is a martingale (where 
(£) is the predictable quadratic variation of C). If M = {N t )t>o is a 
P-local martingale, and Q is defined via 



dQ 
dP 



then M — {C,Af) is a Q-local martingale. Here, (C,ftf) is the (pre- 
dictable) covariation process between C and M . (See e.g. Kallenberg, 
2002, 18.19, 18.21.) 

Proposition 4.8 (Change of measure). For j/G§, let 

oo oo 

(4.11) Ki(y) := ^ ky k , K 2 (y) := ^(fc - Ki(y)) 2 y k 

k=0 k=0 

be the expectation and variance ofy, provided they exist. Let x£§£ for some 
£ > and X = (X(t))t>n be a solution of the (S,x,G^,J-)-martingale prob- 
lem and denote its distribution by P a . Then, the process Z a,a ' = (Z" ,a )t>o, 
given by 



Z 



(4.12) 



1 = exp (^N(a — a)(^Ki(X_(t)) — k\(x) 



J* A - 7«l(2C(*)) " ^^n 2 {X{s))ds)) 
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is a P a -local martingale. If a' > a it is even a P a -martingale and the 
probability measure P a , defined by 



dP L 



dP c 



solves the (§, x, G% , J- ) -martingale problem. 



Proof. The proof is an application of the Girsanov transform for con- 
tinuous semimartingales; see Remark 4.7.2. By assumption, the process X 
is continuous, and so is the processes {f {X_(t)))t>o for / as in (4.10). Set 

g(x) := N(a — a')n\(x) 

and define C = (Lt)t>o by 

L t = N(a - a) («i(X(i)) - ki(X(0)) -J G^K 1 (X(s)dsJ 

= N(a - a ) (Ki(X(t)) - ki(X(0)) - J A - 7«i (£(«)) - aK 2 (X(s))ds^ . 
Then, C is a P Q -martingale by Lemma 4.6 with quadratic variation 
(C) t = N 2 (a - a') 2 f G? cs {Ki(X(s))) 2 ds 



= N(a-a') 2 / K 2 (X(s))ds. 
Jo 

For / £ F, let Af f = (N f (t)) t > be as in (4.6). Then, for / = f v £ T, 

(c,Nf) t = rG^{ g m'))fms)))-gm*))G^fuas))da 

Jo 

= a -a_ / J2x k (s)(d M -X t (s))(<p(k)l + kip(£))ds 

^° k,e=o 

t 



GZjms)) - G« el f(X(s))ds. 

By an analogous calculation, one checks that the same identity is valid for 
all / £ T . Since £ is a P a (-local) martingale, the process Z a ' a as well is a 
P a -local martingale (see Kallenberg, 2002, Lemma 18.21). 
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If a < a' and x £ (and since e^ Kl ^ < h^(x) by Jensen's inequality), we 
have that E[sup 0<t<T Z"' a ] < oo. Hence, using Remark 4.7.1, we see that 
Z a ' a ' is a P°- martingale. The above calculations and the Girsanov theorem 
for continuous semimartingales (recalled in Remark 4.7.2) then show that 

N f (t) - (£,Mf) t = f(X(t)) ~ f Gif{X{s))ds 

Jo 

is a P a '-martingale. Since / € T was arbitrary, P a ' solves the (S,x, G^,F)- 
martingale problem. □ 

4.3. Proof of Theorem 1. First we will prove Proposition 4.4 on the well- 
posedness of the martingale problem for G%- The proof of Theorem 1 will 
then be completed by observing that a process solves the system of SDEs 
(*) iff it solves the martingale problem for G^ (Lemma 4.9). 



Proof of Proposition 4.4. 
Step 1: Existence of a solution of the martingale problem: 
For a = 0, it follows from classical theory (e.g. Dawson, 1993, Theorem 
5.4.1) that the (§, x, G^, J-")-martingale problem has a unique solution P°. 
By Proposition 4.8, the change of measure using the martingale Z 0,a leads 
to a distribution P a that solves the (§, x, G%, ^-martingale problem. This 
establishes existence. 

Step 2: Uniqueness of solutions of the martingale problem: 
As in Step 1, let P° be the unique solution of the (S,sc, G x , ^-martingale 
problem. Assume P" and P2 are two different solutions of the (S, x, GJ, J-)- 
martingale problem. Let t%, T2, . . . be stopping times with r n — > 00 as n — > 00 
such that (Zf^ T )t>0i given by (4.12), is both a Pf-martingale and a P^- 
martingale. Since P" 7^ Pf , there must be t > such that the distributions 
of X(t) under P" and Pf are different (see Theorem 4.4.2 in Ethier and 
Kurtz, 1986). Hence, there is an n S N such that the distributions of X_(t Ar n ) 
under P" and Pf are different. Since is positive P"-a.s. and Pf-a.s., 

then also the distributions of X_(t A r n ) under Z^ T • P" and Z^ T • Pf are 
different. However, by the same arguments as in the proof of Proposition 4.8, 
Z^ Tn -P" as well as Z°^ n -Pf equal P° on the cr-algebra cr((X(s))o<s<MT n ), 
which contradicts the assumed inequality of P" and Pf . Thus, uniqueness 
of the (S, x, G%, ^-martingale problem follows. □ 
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Lemma 4.9 (Equivalence of SDEs and martingale problem) . For x£E>^, 
a process X = (X(t))t>r> is a weak solution of the system of SDEs (*) starting 
in x iff the distribution of X is a solution to the (§, X, G^, J 7 ) -martingale 
problem. 

Proof. 1. Assume that X = (X_(t))t>o solves the system of SDEs (*). 
Then, as a direct consequence of Ito's lemma, the distribution of X is a 
solution to the (5, x, G^, ^-martingale problem. 

2. Conversely, let X = (2L(t))t>o solve the (§>, x, G%, ^-martingale prob- 
lem. To see that X is a weak solution of (*), we may appeal to Da Prato 
and Zabczyk, 1992, Theorem 8.2. Specifically, in their notation, choose H as 
the Hilbert-space of square-summable elements of M N °, M = (A/"jfc)fc=o,i,2,... 
with f k (x) := Xk, let Q be the identity on r( 2°) = {(wke)k<e '■ Wkt £ R}> 
and let : r( 2°) — y M N o be given through the matrix ^(s)^ : = 



5. Proof of Theorem 2. The key element in the proof of Theorem 2 
is Proposition 5.2 which represents a solution of (3.5) through a Markov 
jump process. For uniqueness of the solution we rely on a duality derived in 
Section 5.2. The proof of Theorem 2 is given in Section 5.3. 

5.1. A particle system. As a preparation to the proof of Theorem 2, we 
represent the system of ordinary differential equations by a jump process 
(K t )t>o- Almost surely, the process will be killed (i.e. hit a cemetery state) 
in finite time. We show in Proposition 5.2 that a solution of (3.5) is given 
by the distribution of Kt conditioned on not being killed by time t, t > 0. 

Definition 5.1 (Jump process). Let (K t )t>o be a pure Markov jump 
process which takes values in {f,0,l,2,...} and jumps from k to k + 1 at 
rate A, from k to k — 1 at rate k^, and from k to the cemetery state f with 
rate ak. 

Proposition 5.2 (Particle representation). Let x(0) £ for some 
£ > and (Kt)t>o be as in Definition 5.1 with initial distribution given 
by P[K = k}= x~ k (0). Then, 



{Sik ~ 5ii)y / X k (s)X i (s). 



□ 



(5.1) 



x k (t) :=V[K t = k\K t ^\}. 



solves the system (3.5). 
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Proof. From the definition of (Kt)t>o, it is clear that for small e > 0, 

x k (t)(l - ake) + A(x k _i(t) - x k {t))e + j((k + l)x k+1 {t) ~ kx k (t))e 



x k {t + e) 



1 -aEto fe 'W £ 

+ 0(e 2 ) 



= x k (t) + (-a(k -^£xt(t))x k (t) + A(» fc _i(t) - a*(*)) 

£=0 

+ 7 ((A: + l)x k+1 {t) - kx k (t))y + 0(e 2 ), 

which implies the result as e — > 0. □ 

5.2. Dynamics of the cumulant generating function. The proof of 
uniqueness of (3.5) requires some preliminary computations which we carry 
out next. Recall the function from (3.2). Note the function £ i— > log/i^(x) 
is the cumulant generating function of x G §. Cumulants have already be 
proven to be useful in the study of Muher's ratchet; see Etheridge et al. 
(2008). Here, we compute the dynamics of the cumulant generating func- 
tion. 

Proposition 5.3 (Dynamics of cumulant generating function). For any 
solution 1 1 — y x(t) of (3.5) taking values in for £ > and < £ < £, 

d °° d 

- log h c (x(t)) = a ^ txt(t) + A(e C - 1) - (a + 7 (1 - e^)) — log h ( (x(t)). 

£=0 * 

Proof. Abbreviating x := x(t), we compute 



h((x)— logh ( (x) = tyxix^ + A^(x fc „i - x k )e ck 



oo 

«(( 

f=0 



£=0 fc=0 fc=0 
d_ 



fc=0 

^Tfe,)/i c (x) - ^/»c(*)) + A (e C " l)^cfe) 



7 (l- e -C)A^(s) 



and so 



— log/i ? (x) = a^£x£ + A(e c - 1) - (a + 7(1 - e~ c ))— log/i c (x). n 
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The equation in Proposition 5.3 relates the time-derivative of log h^(x{t)) 
with the ^-derivative of the same function and leads to a duality relation 
formulated in Corollary 5.4. In Markov process theory, dualities are par- 
ticularly useful to obtain uniqueness results (cf. Ethier and Kurtz, 1986, 
p. 188ff). Our application in Subsection 5.3 will be in this spirit. 

Corollary 5.4 (Duality). Let t i-> x(t) be a solution of (3.5) taking 
values in for £ > 0. Moreover let £ : t \-t £(i) be the solution of £' = 
— (a + 7(1 — e — starting in some £(0) < £. Then, 

ft 00 
log /» c(0) (*(*)) = logfc c(t) Gr(0)) + / (A(e^~ s ) - 1) + da. 

Proof. Using Proposition 5.3 and noting, for any differentiable g : £ 1— > 
#(£), the equality 

±g(& - s)) = (a + 7 (1 - e-^))j- c g(C(t - s)), 

we obtain 

, 00 

logh at _ s) {x{s)) = A(e«'" s ) - 1) +a^tx t [8). 
s e=o 

Now the assertion follows by integrating. □ 

5.3. Proof of Theorem 2. We proceed in two steps. First, we derive an 
explicit solution of (3.5) by using Proposition 5.2, i.e. by computing the 
distribution of the jump process (K t )t>o conditioned on not being killed by 
time t. This will result in the right hand side of (3.6). In a second step, we 
show uniqueness of solutions of (3.5) in §£. 

Step 1: Computation of the right hand side of (5.1): 

In order to derive an explicit formula for the probability specified in (5.1), 
we note that the process (Kt)t>o can be realized as the following mutation- 
couting process: 

• Start with Kq mutations, with the random number Kq distributed 
according to (x fe (0)) fc= o,i,2,...- 

• New mutations arise at rate A. 

• Every mutation (present from the start or newly arisen) starts an 
exponential waiting time with parameter a + 7. If this waiting time 
expires, then with probability the process jumps to f, and with 
the complementary probability the mutation disappears. 
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With Xk(t) defined by (5.1), we decompose the probability of the event 
{Kt = k} with respect to the number of mutations present at time 0. If 
Kq = i, a number j < % A k of these initial mutations are not compensated 
by time t and the remaining i — j are compensated. In addition, a number 
I > k — j mutations arise at times < t\ < • • • < t\ < t. Prom these, 
I — k + j are compensated and the remaining k — j are not compensated. 
These arguments lead to the following calculation, where we write ~ for 
equality up to factors not depending on k. The first ~ comes from the fact 
that the right hand side is the unconditional probability ~P[Kf = k], 

oo iAk / .\ . . 

*w ~ £*<«))£ (;.) (^-(i - e -^>-))"' ■ 

oo „ 

'= fc -J{T=(ii,...A): 
0<ti<-<ti} 

Yl 7 (! c~ (a+7)(f ~ r ' ) ) e _(a+7)( *- s) 

5CT re<S ° + 7 seT\5 
|S|=Z-fc+j 

oo iAk / .\ . . 

J—h _ e -( a +7)*)Y _J . e -i(«+7)* 



i=0 j=0 

00 u 



E r~ At / ^-.*o E 

l=k—j (Tit 4-\ SCT 

{T={ti,...,tir- \s\-r-k-v-4 



rgiS a + 7 ser\5 

l \( 1 h _ e -(«+7)M' J e -i("+7)t 



e*«»eG)(^ (1 



(k-j)\\J 

AV 7 



oo -i ,.i , 
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oo iAk i .>. . . 

~ E*<«»E (J) (^t 1 - e-<^><))-V«^>< 

i=0 j=0 v/ ' 

/ 1 .(1 _ e -(«+7)^ fc-i 



(A; — j)! Va + 7 

where the first '=' comes from the symmetry of the integrand. Summing the 
right hand side gives 

oo i / -\ ■_■ 

J—(\ _ p -(«+7)^Y J e -j(a+~f)t 



i=0 j=0 



V A " ' f^_(l- e -("+7)t^ fc j 

^ (Jfe-j)! U + 7 V ; 

k—j 

7 « . Q+ V) t y _____ / A 



Hence, 



£ ,,(0) £ (j)(i(-^)<-e-«^^(M- S ^)'- 

, . i=0 j=0 

w) = 55 : 

£ ^(0)(^ - ^e-(«+7)*) 1 • exp (^(1 - e-(«+7)*)) 

which shows (3.6). To see (3.7), it suffices to note that all terms in the 
numerator except that for j = converge to as t — > oo. Hence the result 
is proved. 

Step 2: Uniqueness in Sf. 

Let (y(t))t>o be a solution of (3.5) starting in y(0) E §£. From the analogue of 
Lemma 4.5 in the case N = oo we have h^(y(t)) < h^(y(0)) exp(Ai(e^ — 1)) < 
oo, i.e. y(t) G §>_ for all t > 0. 

If (a_(t))_>o and (y(t)) t >o are solutions of (3.5) with x(0) = y(0) G §£, 
then we obtain from Corollary 5.4 that for all < £ < £ and any t > 

„_ oo 

(5.2) togfc f (a#))-logfc C (_/(t))= / 

^ £=0 



Since only the left-hand side depends on this enforces that both sides 
vanish. Indeed, taking derivatives with respect to £ at <_ = the previous 
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equality gives 

oo 

5^(x/(t) - W(t)) = 0, t>0. 

1=0 

Plugging this back into (5.2) gives 

(5.3) \ogh c {x{t)) = \ogh c {y(t)), t>0. 

Since the function £ h-» log/i^(x) (for < £ < £) characterizes x 6 §£, we 
obtain that x(i) = This completes the proof of Theorem 2. 
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